Searching PAJ 



PATENT ABSTRACTS OF JAPAN 



1/1 ^— v 

(a; 



(1 OPublication number : 2004-145172 
(43)Date of publication of application : 20.05.2004 



(51)Int.CI. 



- V - ~ ^ .. -*-^™'» 



61 OL 15/20 
G01S 3/802 
G10L 15/28 
G10L 21/02 



(21 Application number : 2002-312204 
(22)Date of filing : 28.1 0.2002 



(71) Applicant : 

(72) Inventor : 



NIPPON TELEGR & TELEPH CORP <NTT> 

SAWADA H1ROSHI 
MUKAI MAKOTO 
ARAKI AKIKO 
MAKINO SHOJI 



v* Hlj "if " 



(54) METHOD, APPARATUS AND PROGRAM FOR BUND SIGNAL SEPARATION, AND 
PROGRAM IS RECORDED 

(57)Abstract 

PROBLEM TO BE SOLVED: To highly accurately solve a permutation of blind signal 
separation by combining a solution of permutation by the arrival direction of a signal 
and a solution of permutation by the similarity of a separated signal. 
SOLUTION: When the permutation is solved after (s1) performing short time Fourier 
transformation of an observation signal, (s2) finding separation matrixes at each 
frequency by independent component analysis, (s3) estimating arrival directions of 
signals extracted from each row of the separation matrixes at each frequency, (s4) 
judging whether the estimated values are reliable enough, (s5) calculating similarities 
of separated signals between frequencies, and (s6) finding separation matrixes at each 
frequency, a permutation is determined by making uniform the arrival directions of the 
signals at frequencies at which it is judged the estimation of the arrival directions are 
reliable enough, or a permutation is so determined at other frequencies that 
similarities of the separated signals to nearby frequencies increase. 
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(57) [Rfa] 

[R0] ^^>Kfl^#gfK::fc#£p ermutat 
i o n£ff^CD§rj3te;frftK:ci:& p ermutat i on 
(DM& t ^mmn<omimS. tC <fc &permutat i o 

imfc^m (si) «aH«#*fi«FiB7- yxsafto 
, ( s 2 ) te&mfttftc <t &m$t$k°?<Dftmtt 

Hub* ( s 3 ) ft«jfttt-c<o»«tTWa>StT *c J: 9 EX 9 

asnsft#(Dai*^ia]*}S5eL, < s 4 ) ^-co«^fii 

36H-»tcm«-C*4*i'^*«:*!l5eL, < s 5) M&Sfc 
PBl"C(0»gtm^cD®MS^It#U. ( s 6 ) »««BR"C 
^BttT^Ji^/dt-CA'- ^ ^ <r-*> 3 > ( p e r m u 

t a t i o n) fcJBifc-r'BBWC, «#<Difl**fiI©«tffi 

& £ 2 n/cJS&»r te^n <E><D:fr 
ft£}ii^x.<5C<^:'Cp ermutat i on * 

ig&SJ^Cp ermutat i on £&^*r&o 



: xtt) 



1 



81 



s2 



s3 



s4 



s5 



: ^n6<D75f3£HSxSCfc'CDermutattor>&&S 
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$gl$ ffl 7 - ') x.^& L T^^^M T~Ofr8ft'{5-^(7>»lj££ ft»1- & £ , 

^MWS^J^^fetttA-- ^f-y a > (permutation) 

m^vm^m <nmfctf±fr k m mx % & t m £ $ ti tz m &&-c it -e *t <b ^ ^ rsi £ its 2. 

<7)H^JK £ ^ £> & J: ? permutation £&5eLT^ < ^Jlfi£>fi"f d t 

^SIcT^t?!)***^-?^- 5 ar-y a > (permutation) *ffi$k 

m ^ <V m h 7j ft <t>3£ fetf + 5^ ffi «R -C i * t f U 5e $ *L J§ T li * ft £ <7> |6] £ 415 x_ & 
iitpermutatio n*8HeU ^O-ffi<0® jK»cniifi#<7)ffli8[«[ t 0#HM§-§- 
(D&UBt&HtibZX $fcpermut at i on *&5eLTv* < ^gfc, *ffix_tzZ.b £ 

^JlStt'&flff ?IJ * fcttvN'- 5 a f - y a > (permutation) 

# <t> u * ip] <o m 5c -t- 53- k # «-c § * t *u 5e $ *l * -c it * *l h<r>^n*m*-2> 

US* *> J: ^l-permutatio n ^^:5e LT v> < $!k3g i: > Sra^tTa-^ 

&Mfe&Xfrmftm*i&)btzl : kX-^- § i-r--7 a > (permutation) ^fl?^: 

:itpermutatio n^^Jtt^ ^Ofll^HaEjfe-CttJtt^^ffljftlkfc W^SH'S^- 
oSIRgp * S5 * * J: ?Kpermutafio n $t^:5e LT^ < 4HkS t , 
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[ 0 0 0 1 ] 

t^pTt^^^o ^#^-^M1-&^ffl^J t LTfi. B-^ISMff <7) yoy h j^y Ft L 
[0 0 0 2] 

Nm<D^-%tfm.-€r2tirMm (m^n) (v-tyy-x-mmztitzt-r&o *§&wxa, m^r 

LT^^Mt&tta^S^ o icoJ:^^ST^i^lt Sff s p (t) (t :^ 
M, 1< P^N) ^t>-b>^x , (t) ( 1< q ^M) ^O-f >^W*J&^h q p (k) 

[&1] 

x q (t)-I?-,I k h q p(k)sp(t-k) t/jis. 

y K#-s§-53*Sloliftfi, iRi^s, (t) w?;v*)S^h, p (k) £*a*>-f 

I:, HM-t x < (t) 0*^^.fl-i©fc*OFIR (Finite Impulse 
Response) V 4 fr9 0>#gtw , , (k) 
[&2] 

y r (t)-I^,I k w„(k)x,(t-k) £3fcj&5C<!:t;:&<5. 



— UtfcSflHl- s p ( t ) tt:Ev»K»:fc-CJb*fc«&, »it*^*f ( I C A : I n d e p e 
ndent Component Analysis) £JB ^Xfrn.<Dtztb(D 7 4 JV*# 
$cw r t (k) *tHfC§*o I C ASrfflv^'(t-i-59-tto^»wji«>«r*'bo*«2b**«. 
^# K M ^ 1" & & K ti 

[0 0 0 3] 

s»jfe««^>^ffi-c»i, -7^jv^#^w, q (k) ^©s« 

&l&#W r , (f) * I C A^fflV^Tlt#i-^o -tOfci&H. if, ^>*qt^|Sif 
-tx, (t) Kfflli*n«tfc7-yiSE»*afflLTX q (f,m) ^M.^ffli 

#ja$Kgc f "Clft^ii^ I C A : 

mi] 
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Y(f,m) =W (f) X (f.m) &M<* 
Z :tw (f) fiI*W„ (f) P X Q©?T?iJT& 0 . X (f,m) = [X i (f,m) , 

• • ,X« (f,m) ] T ,Y (f,m) = ( Y , (f,m) , • • ■ ,Yf (f,m) ] T T?$> Z. 

W%.\** N=M=2T*S5i^ (01 #88) tt 

Xi(f.m)' 
_X 2 (f,m). 



*Yi(f,m)" 




"w„(f) 


w, 2 (f) 


_Y 2 (f,m)_ 




w 21 (f) 


w 22 (f) 



(1) 



I CATtt. W(flOff* f An*t>oTt)Y(f.m)©ai3Lttttfiifcn*. 
tfiJAtf, N=M=2TS5MH 5£ (1) *3V^TW(f) O 1 ff § 
[Wu(f) W12 (f)]*iY. (f,m) ££j3cUT43D, 2?T@[W 21 (f) W 22 (f)] 
^Y 2 (f,m) Sr^fiJcLT^-S. *> HEfCW (f) (D 1 ff S £ 2 ff @ £An#*.7c 
tLTfc^ Y , (f,m) t Y 2 (f,m) JiUnt^S fitt, Y (f,m) ©fflSttttt 
{£fcn&e £U:<D ffiK<0 2o<Dfijjft» f it f 2©|BJ"e 

Yr (f ,,m) £ Yr (f 2 ,m) LT v> S £: «IR £&v>. 

ffi z. Z> 'tt^tflb & o CltL* 5 ^- 5 — a > (permutat ion) ©|!{H6T*$>% 

o d*L*»«febfc«, w, , (f ) na»«itk7-UiagiftS:ifci-i t-c, »fc*o7 

4 ;v*#&Cw, q (k) * s f^t$iSo WT, p e r mu t a t i o n©W«£#& 
[0 0 0 4 ] 

[##©SI*2r6lK «t4 p e rmu t a t i o n <Dffife] 

logwt^gfli, OT<^*#fa*#6fe-r4£fc KJ:* permutat i o n©ft? 

tT^J^^f^^aiL-cv^^^-opj^^iqje (f) = [e, (f) , • • 9p (f 

) ] T ^i^Tititf/permutat i on«t^-H s tiS 0 

i-&o s p fa* o° ^180° (tvt^vtili^^g o 

° ) , t>tq(?)ff*d, fctii, «^*©JS«ScJ£#liH, p (f) - exp (j 
2,rf c - 1 d, cosfl P ) (c fi#-^Oi3tJg) . tJt, fcJ&0 P fc* 

[&3] 
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I q Wra<f)*H a p(0 tit. *tf6]4#14 

B,(f,0p) = I q Wrn(O-exp(27t fc" l d q cos6 p ) 
[0 0 0 5] 

)iIt3 15 2Hz*l^i:, #«fr?!l<*> 1 ffl Y , ^x.^Jg|P]#14^ 4 1 ° 

56««/h t * o T * >9 , 2 3 ff§Y 2 ri s ^x_*jgft#14»i 1 3 2° W /'^Mt^cTV> 

So i«:i^f), frttff yd O Iff 1 Y it 4 1° ^t>ai*i"4'd#*ttlffiLT 1 3 2° a* 

feSO^i-lt-^WJ aiL. li:3-ifi?iJ(0 2fTBY 2 lii 3 2° a^SI*-*-*^^ 

J±LT4 1° (HU^io lot, 9 (3 152Hz) = [13 

2, 41] T ti^-CHo ra»K««tJfc3 1 5 6 H z fcfc^Ttt, 0 (3156Hz) 
= [4 5, 1 2 6] T ti^ti^o ^^^^mtt-Ctip e rmu t a t i o n^oT 
v»4v>fca& % 3152Hz (D^^TM^s'k XHW-^-X permutat i on £ttifx.& 

> *;|t£><??#|fi!J J: »9 p e r m u t a t io n*iftt4ii:A J fi4o L 

a»U v> < oa><&jg«E&-eii, *M >ri*ft/hfc £&£}J£0° ^180° fc#*E*1 r 

/h$v>fc&> -eoi ? :fe^^ s #v^ 0 -€-*Lt>ojg«[S5:-C»i p e r m u t a t i o 

[0 0 0 6] 

[^ll^^iM^ Upermutat ion <7>#ft£] 

2ol£>*jE*8£#W; % frWMS-f-^&IRj&fcJ: & p e rmu t a t i o n^iSt*'* (tffl 

2 #HS) « 

&2> 2^><Dm$L$L~?<Dfrmm-%Y , (f, , m) i:Y, (f,. m) <^«1ftJK»i. 
2o<7)|# x (n) k y (n) <7>*ifl|{±c or (x, y) = [<x y>-<x> <y 

>] / U , • , ) •c^-x.fetLio ££-e< • xi&tK^K * i±If^i-e*So c 

or (x t x) = l-e^f), x i y* s SS+|RC^^Jf c or (x, y) = OT^So 

2ow^«SL|k-c<7>^MHg-f-Y r (f, , m) kY, (f 2 , m) 14, fctAt^W 1 

ttS*4o^f,r*4o frSMf-^Y, (f , m) Ojfifttto&iftiHl (Rfi^tW^J 

[*4] 

V,tf.»)-2^TTl,« JY r («l (2) 

lifrflMB-f-Y, (f, m) i#-fciftv> % raCii^HMlBi-**^ #^ffl#OU*3&T 
SSv>ffiM*i*oifc*«^p^>itT^* 0 tot £*i 138 fcffHt-* - * i ttpermut 
at ion £f&&-e# &o J2Mfctf)fJiWei;JU permutat ion**: 1 1 , ••• 
, N| — I 1 , •••,N| t*ii,t-&o N= 2 permutat i 

o n £^ML&ltti(f n- (1) =1, n (2) = 2 "Cab «J % permutat ion £A 
*i« t x.*U*>r (1) =2, 7T (2) =l-e*-& 0 f*«iLTIi> HS&toaSD&T 

^Sitffli^^f < J: 9 

[ffe5] 
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K ,=arg max „£ , g _ , , SD I?. , cor [ V„ (p) (f) , V*. < P >(g) 1 ( 3 ) 

Kg-^iJSIifcSfci "C^p ermutat i om, £*i&Tv» < ^ft7i s #ffi-r £"C 
«• g fiJU^^Cg "CO permutat ion "C&& 0 
[0 0 0 7 ] 

mmpfXM 1 1 

S. Kurita, H. Saruwatari, S. Kaj i t a , K. Taked 
a, and F. Itakura, "Evaluation ofblind si 
gna 1 separation method using directivity 

pattern under reverberant conditions," 
in Proc. ICASSP2000, 2000, pp. 314 0- 3143 

S. Ikeda and N.Murata, "An approach to bl 
ind source separation of speech signals, 

in Proc. ICANN ' 98, Sep. 1998, pp. 761-7 

6 6 

[0 0 0 8] 

[^I^t^^^ l, i "9 k~$~Z> PUH] 
'&*<D&ffit LX&frLfc permutat i o n 14 v . ZH^fi&TcyK&tf 

7tfe> ifeJfcO&flrcgilHLfc <t "5 £•> v»<oj&^JS«#-C#faA<«£^S*v»£.J:. 2b % 

Tttp ermutat i o n**fc£"C£ ft^ofc "») Ma*x.fc »9 1-&o LT^Si, 
n < o^<7)i§^^-et'9 LT*b p e r m u t a t i o n ^Mis? iftffi^K perm 

u t a t i o n»LTi/^i:liIx.^i>o 

— 2 oil <a5frl*##<a§KiR§£fc J: & 5£ (3) CftoTp ermutat i o 

n £E!$:-r&*:£>, -f^T^Ji^^lf V (b i n) "C p ermutat i o n7M$:5e-C# 

3J*:fr|q]fc "bo* <9^v> 0 L^L> JS#?)jg&E& t OfflttWfcMfSfc i Ipe r mu 
t a t i o n^SEL^</:fe, ^£5&>Ojgifc&-CMjfc;t*ttf> •£ <7>3fcOJH T 
fc*sv»TMiS;i*£ t C^Jo fcT> -f -<T<^javS^-CiE permutat ion 
*«#fe*LittfAv»A«, t^35^J§^-CHiS£^^c7)^${i^^:-e^^7 l ci6> gcJ&tSfeK 

fc»t* ^ 9 & "C^UB fcrC »* ^ o 

-e^-c^f&^lftf*. ±IB2 o^Sri^-LTfeB^^^ISM L-^v>> «ffiJg-C 
££'ft<D&&p e rmu t a t i o n OfS^fe^ftt* i t t*4 e 
[ 0 0 0 9 ] 

[SiBS'jJPfttifcftO^li] 
ilJ*^fSj^5e'(it5$ i f) permutation £&5eL. 

JgjeSftfc (mSctt^+^t^JS-cg*) g$S![?)p e rmu t a t i o n»i£M-£-ffc 
> J&Se$4a*^S«»^liS#OiS*»tO^M^-Offi1ttJK^^^ p ermutat 

i o n^^tJii^ittJo 

[0010] 
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Z<DWffllt'&%;<D8i.ffi-?m.W Ltzo Z.<V*<Dp e rmu t a t i o n#&8BK 

s 1 : HSM $sb# M 7 -V j^&U 

s 6 : #E$g^-C#»fr3ni p e r m u t a t i o ntmfc-r&mK, 

p e rmu t a t i 0 nSrfcjeU -e©fl6<Oll*»C (#^<?>£J#;fr[B]<^jEaMl5lg-e§ * 

u t a t i 0 n £rik5c"f~& o 
[0011] 

HI 4 fi> #3§fl<7>p e r m u t a t i o n ^i£gB<7>mj£?!l 7*n y *H-C$>& 0 

p e rmu t a t i o nfSfcSBIi, -@-^>SI*#ftlfc «fc * permut-at io n?##!:$B 

#«Mg-^*>MlJ8?fc J: * p e r m u t a t i o nJ#&g&-e«fife3*ifco 
4§-f-©KI*:£lRjK. J: & permutat i o n»*SR"C»i> 

2 ] 

ZL permutation £fl¥&L> -^(DtggkW' (f) £ Hi ^ ~T & » HWrt. J^i&& 

fix fetB^tS. fix (Dg^tite SJl&gcTte, SJ3fe#fp]0>ii£ flirt* 

■fS«-e*-5fc«>, ttl \Z «fc £ permutation WlS^MIW (f) &£k&<D®.mX 
JEILft^. #AHf*©«<HS (4BIH) permutation 8? & SB T*&, 

fix fC-g-^n^l/^i^iciCMbT, DEfC permutation AtRSoT^SSKfti 
<7)#8ift^<Z>3i{mS£ft^f £ -t"C permutation £rfl¥&L, S^^S* 

w" (f) ^tti^j-r^. 



[0012] 

[#-5!-<7)£!J*^lPm i & permutat i o n^)M] 
HI 5 -®#OiU*#fafc J: 4 p e r mu t a t i o n^^#i5co^fiE;^/jt-r 7'n y ^ (H"C 

iMCUpe rmu t a t i o nJPMJfgp-Cf*, ^*<7?^"eUi^ Lfe^ffift 

^^«^^^f?iJO^f75 s t'0^lR]c75'(i-^^^«9 ttl LTv^^Sr^LTQ (f 
) ^m*1"4o ^i:Up e r m u t a t i o n&SESBTNi, #JS«&KJ3V>Ti£5E3 
*ifc#-§-0>g|*;frlRje (f) fc2£-2§, 
[^3] 
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ttMftnWif) ©fr&7 — htT-e©^I^W' (f) lit permutation 

t 

it *< X + 55- #P J± £ tL T i h 

loi^^i, si^rsmse^m^e (f) mfg-%kmc&<DMfcm*&^x^ 

$>&m$L%t:x*mfmm&5 3° 1 1 3 4° -c&tu*. iti^ti^t <^&<b& 
Meb, (f, <9 P ) cor^ y*tfm.-fz> z bxmfcx^ & 0 m^if. 117 K^-r^m^ 

&Xli, 3 15 2Hz, 3 1 5 6 H zJOLjoKte^X, #PEE S ^-^ s -h:frK#pj£ £ 

tLTV^^r^fr^i^fo HI 8 K7jk-t 3 1 2 H z ^[Wt^f^ 0 ( 3 1 2 H 

z) = [114, 7 0] T ^ftW^EKiSlt&JifMf^^r^ >£ft$ri-& 

B, (312Hz, 114) =0. 601, B 2 (312Hz, 114) = 0. 53 
7, B, "(312Hz. 70) = 0. 325, B 2 (312Hz, 70) = 0. 7432: 

. 537/0. 601=0. 894, 0. 325/0. 743 = 0. 4 3 7 X$> *) , +33* 



p e rmu t a t i o n£8?&U llIf^^^-^5E^ s +^^#5^-C^ S^t"? *0*UJfe 

^JS-C**fl9«tjfifctt f i x^Ift^oTV^o f i xfcJRSfc^JSS&feTNi, €^-<??¥IJ 

t i onOM^i*!i!>WSo 
[0 0 13] 

[#SMM-£>S1HJKfc p e r mu t a t io n<0#&] 
Hl6fi> Mf^IMl^J p e rmu t a t i o n»ftSP<OfltfifcS:^-r 7"n y ? B 

[^5] 
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V(f,n) = [V, (f,n),« • • ,V P (f,n)] T 

*fgl$<2#$[te, if •^•OHJ*^jS](ClSO*ViT^^$n7c permutation <D 
MS fix lzm-?Z>m$i?k<D permutation £'£lE-f £ :i)i<, Ift^ fix \Z 
m2fe.^m$L&<Z) permutation ^Htii^O^^M<D^||V (f,n) <7)*@ US 

permutation #t & SB T f T t> tl •§ <■ 

***fc#!)-Cf;jU p e r mu t a t i o n#&5eL*r (-f &=b*>^f i x KM^T*) 
ffl$L$t.t <DQM$i<DmM* , mhfrK-XZ < t § £ JBttftd* ^ P e.rmutation* 

i x K:JR-r*fflJRSS:fc O^Ml^+BMOfl] 

[&6] 

Li.-fl«D*«i. E^-iCorCV.^.V^wte)] (4) 



£-<t;M~ i~£> permutation t ^-Oft^cfitm axCor f £^£>&o ii"Cn- g 
{ij^?K^:g-e<7)p e r mu t a t i o n-e&& 0 m a x C o r f b Z> 

9k i £S*>\ ^Op ermu.tationif, i LTftSeL, i * f i x <E>353fc 

ttJ„ permute (W, n- ) permutations- i:ftotW^T 

J^±<7)#&K<fc 19. -f^-COj^&KJS^T p e r m u t a t i o n* s ^tSo 
[0014] 

u ffl -r ^» ss* t % cd-rom, m^rv^^m, ^##**y*^«*»*JR*>*r 

n/7A$)S^ ytWWkfr LTfxMS *ifc^?>f > K#^^St^n ^5 A {i 3 > e a. - * 
[0 0 15] 

-To 

fcBHU 3 0 0 m s <7M ^OU* Jfrgr , . A S J flffcffl^a-^ 

*^^/i8#<7>^7*-? 1 2&£fi*&^-Ci^#-§-£f£j£Lfco fi S N R ( 
signal-to-noise ratio) t tTlt# L U tftft 

Ji^T*- ^<7)0lcMjSi-£o " av" lil2ifl©W*4o Jt«!tf)fc*p e rmu t 
a t i 0 n^)»ft»ciiJSLT<0 3oo*te*ffl^fc 0 " d i r " fcMg-§-tf>SI*#fi]fc 
8U " c 0 r" li^Kfll-f-OflHttJKt J:*^^ " bot h" \t T&n £ L #3£K K 
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cor" tmii;K&^Wi&i>&&tfm^m&i>$> 1 0£fc&^MZ>o "hot h" lif&fc 

#^PJ*^l«0^J:4^ffi-Cfi^ia!Ji:^?j(fiW-fl<J'5:3£*'Cp e r mu t a t t i o n £8£ 

i-S^-CJi, g^»p e rmu t a t i o n^M"el&^ t'Z.fr~cmm 

£«i:|wiJ|tp e rmu t a t i o n£^&-C§;&o 
[HB^fBfiji&i&IE] 

[Hi] 7vA > Kfl|-f-d9*«a)DES*KWi"**:*^iao 

[113] #3&gn r ? W > h~m-%frmi5&<n¥M*jsi-rmo 

[H4] H *t & p e r mu t a t i o n MVk^^ffiWu* t^-? W y 9 Ho 

[@5] HI 4 K*3»t*'|g-fH@j3|5#ftJfc J:* p e r mu t a t i o nffi$tUe>M&*^-1- 7 

[SI 6] HI 4 K33*t&#«M§-5§-£>«lJKfc <£& p e r mu t a t i o n#f&$B<7>1i$;£7F 

[07] 3 152Hz, 3 1 5 6Hzi:i5ltl>JllfO#e©^'f >lr^D-y M^rio 
[118] 3 12Hz K^^n^m^WA y*7uy Y LfcHo 

[H9] frmH^mW&K £ & p e r mu t a t i o n &fc$V><D T )V a" V XA^ti 
°[H1 0] .t^^^^SHStfeOJtite^tTd Ho 
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while ('fifixl 

/•fix IC«SfeViT^TOffl«S f C&friT* (4) fc&^ftr***/ 
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